Haptic effects broadcasting during a group event

ABSTRACT

A system that generates haptic effects during a group event having a plurality of users in attendance receives an identity of a first type of haptic effect to be broadcast during the group event, where the group event includes a plurality of haptic events. The system broadcasts the first type of haptic effect to a first set of the users, where the broadcasting causes the first type of haptic effect to be generated on a device corresponding to each of the first set of users. The first type of haptic effect is synchronized with one of the haptic events.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.14/803,515, filed on Jul. 20, 2015, currently pending, which is acontinuation application of U.S. patent application Ser. No. 13/803,277,filed on Mar. 14, 2013 and which issued as U.S. Pat. No. 9,098,984 onAug. 4, 2015. The contents of each of these applications is herebyincorporated by reference.

FIELD

One embodiment is directed generally to haptic effects, and inparticular to haptic effects broadcasting during a group event.

BACKGROUND INFORMATION

Portable/mobile electronic devices, such as mobile phones, smartphones,camera phones, cameras, personal digital assistants (“PDA”s), etc.,typically include output mechanisms to alert the user of certain eventsthat occur with respect to the devices. For example, a cell phonenormally includes a speaker for audibly notifying the user of anincoming telephone call event. The audible signal may include specificringtones, musical ditties, sound effects, etc. In addition, cell phonesmay include display screens that can be used to visually notify theusers of incoming phone calls.

In some mobile devices, kinesthetic feedback (such as active andresistive force feedback) and/or tactile feedback (such as vibration,texture, and heat) is also provided to the user, more generally knowncollectively as “haptic feedback” or “haptic effects”. Haptic feedbackcan provide cues that enhance and simplify the user interface.Specifically, vibration effects, or vibrotactile haptic effects, may beuseful in providing cues to users of electronic devices to alert theuser to specific events, or provide realistic feedback to create greatersensory immersion within a simulated or virtual environment.

Further, during group events such as movies, music concerts, etc.,various effects are typically broadcast to the group in attendance in amovie theater. In general, audio and video effects during a movie arebroadcast to the group, and in some environments certain members of thegroup may experience different effects than other members. For example,some audio effects through the use of technology such as Dolby® SurroundSound, may sound different to a user depending on where that user issitting in a theater. Further, some “three dimensional” experiences attheaters in theme parks provide “wind”, “rain” and motion effects thatmay be specific to each seat in the theater, no matter who is sitting inthe seat

SUMMARY

One embodiment is a system that generates haptic effects during a groupevent having a plurality of users in attendance. The system receives anidentity of a first type of haptic effect to be broadcast during thegroup event, where the group event includes a plurality of hapticevents. The system broadcasts the first type of haptic effect to a firstset of the users, where the broadcasting causes the first type of hapticeffect to be generated on a device corresponding to each of the firstset of users. The first type of haptic effect is synchronized with oneof the haptic events.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of a system that can implement the centralserver of one embodiment of the invention, and can implement any of themobile devices in separate embodiments of the invention.

FIG. 2 is an overview diagram of a movie theater that illustrates asynchronous example in accordance with one embodiment.

FIG. 3 is an overview diagram of the movie theater that illustratesanother synchronous example in accordance with one embodiment.

FIG. 4 is an overview diagram of the movie theater that illustrates anasynchronous example in accordance with one embodiment.

FIG. 5 is an overview diagram of the movie theater that illustratesanother asynchronous example in accordance with one embodiment.

FIG. 6 is a flow diagram of the functionality of the haptic groupbroadcasting module and the system of FIG. 1 when broadcasting hapticeffects, at the central server, or receiving and generating broadcastedhaptic effects, at each mobile device, in accordance with oneembodiment.

DETAILED DESCRIPTION

One embodiment is a system in which haptic effects, in addition topossibly other effects such as audio and visual, is broadcast to amobile device carried by each user in the audience/group for a groupevent. Each user may receive a different haptic effect at differenttimes, depending on the location of the user in the group. As a result,the experience for each particular user of the group will likely beenhanced.

In one embodiment, a central server/controller broadcasts haptic effectsor other effects to one or more handheld or mobile devices that is inpossession of each member or user of a group in a group event, such as amovie or concert. FIG. 1 is a block diagram of a system 10 that canimplement the central server in one embodiment, and can implement any ofthe mobile devices in separate embodiments. For any of theseimplementations, all of the elements shown in FIG. 1 may not be neededor present. For example, in the central server where haptic effects aregenerally not generated directly on the server, the actuator shown inFIG. 1 may not be included.

System 10 includes a bus 12 or other communication mechanism forcommunicating information, and a processor 22 coupled to bus 12 forprocessing information. Processor 22 may be any type of general orspecific purpose processor. Processor 12 can decide what haptic effectsare to be played and the order in which the effects are played based onhigh level parameters. In general, the high level parameters that definea particular haptic effect include magnitude, frequency and duration.Low level parameters such as streaming motor commands could also be usedto determine a particular haptic effect. A haptic effect may beconsidered “dynamic” if it includes some variation of these parameterswhen the haptic effect is generated or a variation of these parametersbased on a user's interaction.

System 10 further includes a memory 14 for storing information andinstructions to be executed by processor 22. Memory 14 can be comprisedof any combination of random access memory (“RAM”), read only memory(“ROM”), static storage such as a magnetic or optical disk, flashmemory, or any other type of computer-readable medium.

A computer readable medium may be any available medium that can beaccessed by processor 22 and may include both a volatile and nonvolatilemedium, a removable and non-removable medium, a communication medium,and a storage medium. A communication medium may include computerreadable instructions, data structures, program modules or other data ina modulated data signal such as a carrier wave or other transportmechanism, and may include any other form of an information deliverymedium known in the art. A storage medium may include RAM, flash memory,ROM, erasable programmable read-only memory (“EPROM”), electricallyerasable programmable read-only memory (“EEPROM”), registers, hard disk,a removable disk, a compact disk read-only memory (“CD-ROM”), or anyother form of a storage medium known in the art.

In one embodiment, memory 14 stores software modules that providefunctionality when executed by processor 22. The modules include anoperating system 15 that provides operating system functionality forsystem 10. The modules further include a haptic group broadcastingmodule 16 that broadcast haptic effects (when system 10 implements thecentral server), or receives and generates broadcasted haptic effects(when system 10 implements one of the mobile devices), as disclosed inmore detail below. System 10 will typically include one or moreadditional application modules 18 to include additional functionality,such as software to support TouchSense® Haptic Feedback Technology fromImmersion Corp.

System 10 further includes a communication device 20, such as a networkinterface card, to provide wireless network communication, such asBluetooth, infrared, radio, Wi-Fi, or cellular network communication.The communication is between the central server and the mobile devices,and vice versa in some embodiments.

Processor 22 is further coupled via bus 12 to a display 24, such as aLiquid Crystal Display (“LCD”), for displaying a graphicalrepresentation or user interface to a user. The display 24 may be atouch-sensitive input device, such as a touchscreen, configured to sendand receive signals from processor 22, and may be a multi-touchtouchscreen. Display 24 can generate video effects, and further caninclude a speaker to generate audio effects.

System 10 further includes one or more actuators 26. Processor 22 maytransmit a haptic signal associated with a haptic effect to actuator 26,which in turn outputs haptic effects. Actuator 26 may be, for example,an electric motor, an electro-magnetic actuator, a voice coil, a linearresonant actuator, a piezoelectric actuator, a shape memory alloy, anelectro-active polymer, a solenoid, an eccentric rotating mass motor(“ERM”) or a linear resonant actuator (“LRA”).

In addition to actuator 26, system 10 may include other types of hapticoutput devices (not shown) that may be non-mechanical or non-vibratorydevices such as devices that use electrostatic friction (“ESF”),ultrasonic surface friction (“USF”), devices that induce acousticradiation pressure with an ultrasonic haptic transducer, devices thatuse a haptic substrate and a flexible or deformable surface or shapechanging devices and that may be attached to a user's body, devices thatprovide projected haptic output such as a puff of air using an air jet,etc. Multiple haptic output devices with multiple haptic effects cangenerate a haptic effect.

The broadcasted haptic effects can include a wide range of effects andtechnologies, including vibrations, deformation, squeezing, poking,stretching, surface friction, heat, etc. The haptic effects can also beproduced by the mobile device itself or by wearable accessories (e.g., abracelet, a pair of glasses, shoes, a belt, etc.) or by other remoteaccessories (e.g., car keys, laptop computers, music players, or anyother haptically enabled devices).

System 10 further includes one or more sensors 28. Sensor 28 may be anaccelerometer, a gyroscope, a Global Positioning System (“GPS”) sensor,a touch-sensitive input device (e.g., touchscreen, touchpad), a texturestylus, an imaging sensor, or some other type of sensor. Sensor 28 maybe configured to detect changes in acceleration, inclination, inertia,or location. Sensor 28 may also be a location sensor, rotary velocitysensor, light sensor, pressure sensor, texture sensor, camera,microphone, or other type of sensor.

In accordance with one embodiment, the central server broadcastssynchronously (i.e., the same haptic effect to all people) orasynchronously (i.e., a varied effect depending on the location orattribute of each person) haptic effects to a group of users inconjunction with audio/visual events, allowing for an enhancedexperience that could not otherwise be attained by audio/visual effectsalone. Since most users may have a mobile device with them while havingthis viewing experience, a group haptic experience can be created usingthe devices synchronized with audio/visual events on the screen orstage. A group haptic effect can also be generated separate from theaudio/visual event, such as a heartbeat simulating haptic effect eventhough there may be no heart beating audio or visual elements. Becausethe haptic effects are generated by the mobile devices themselves,embodiments are not a seat specific effect as with some known “threedimensional” viewing experiences. The central server may broadcast theactual haptic signal itself (i.e., haptic parameters) or an identity orfunctionality of the haptic effect so that a processor in each receivingmobile device can retrieve the haptic signal from memory or generate thehaptic signal.

As is known in the art, different types of haptic effects can begenerated by varying one or more of the haptic effect parameters such asmagnitude, frequency or duration. Different types of haptic effects canalso be generated by changing the type of actuator or other hapticoutput device that receives the motor signal and generates the hapticeffects. For example, a haptic effect generated by an ERM actuator is adifferent type of haptic effect than one generated by an ESF device.

Embodiments that transmit haptic effects asynchronously based on thelocation of each user first determine the approximate location of eachuser in the group, where each user to receive the haptic effects carriesa mobile device. Known methods for tracking/determining the currentlocation of mobile devices can be used for this purpose. For example, ifthe event is outdoors, GPS-based technology can be used to determine anapproximate location of a mobile device. If the event is indoors, suchas in a movie theater, wireless access points in the theater can be usedfor providing indoor location functionality that tracks the position ofmobile devices or smartphones, such as a “Micro-Location” system fromNearBuy Systems. Other methods to determine the location of each mobiledevice include Wi-Fi, Bluetooth, or near-field communication (“NFC”)based location determination systems.

In one embodiment, each mobile device has a device identifier, and eachmobile device (and optionally the corresponding user) is identified whenthe user is part of the group at the event. In one embodiment, each userwill connect to the network at the event by logging in manually orautomatically, or by using other methods of detection. Based on theidentity of each mobile device, and a mapping of all of the mobiledevices present in the group and corresponding seat location, thecentral server can broadcast different haptic effects to differentdevices based on location if desired. The identity may include theconfiguration of the mobile device, including an identity of theactuators and other haptic output devices available to generate hapticeffects.

Embodiments of the present invention can generally be described inconjunction with an example of an group/audience seated in a movietheater watching a movie. As audience members watch and listen to themovie, they feel haptic effects/events triggered on their mobile devicesbased on specific events within the movie's “haptic track.” The hapticeffects transmitted to the audience's mobile devices may be:

-   -   Exactly the same for each audience member regardless of seating        location or movie event timing (i.e., a synchronous experience        for all);    -   Different for audience members based on seating location or        movie event timing (i.e., an asynchronous experience);    -   Different for audience members based on both seating location        and movie event timing (i.e., an asynchronous example);    -   May or may not also include audio/visual events transmitted to        their mobile devices.

FIG. 2 is an overview diagram of a movie theater 50 that illustrates asynchronous example in accordance with one embodiment. Movie theater 50includes a visual element 55 (e.g., a movie screen), audio elements suchas audio elements 61-64 (e.g., speakers that are part of a surroundsound system), and seats such as seats 71-74, filled with users thateach have a haptically-enabled mobile device such as can be implementedby system 10. Since the example of FIG. 2 is synchronous, each mobiledevice receives the same haptic effect (i.e., haptic effect “H1”).

An event in the movie triggers the same haptic event to play on allusers mobile devices at the same time in the synchronous example. Forexample, there may be a movie scene where it starts to rain andsimultaneously everyone in the audience feels the same haptic rainingsensation through a haptic effect H1 generated on their mobile devicethat simulates rain. In another example, all audience members receivethe feel of a quickening heartbeat simulated haptic effect on theirmobile devices as a character moves through a haunted house or seestheir lover enter the room. In the example of FIG. 2, all audiencemembers feel the same haptic effect at the same time, and the locationof each user is not needed or utilized.

FIG. 3 is an overview diagram of the movie theater 50 that illustratesanother synchronous example in accordance with one embodiment. In thisexample, the location of the user is needed and the seating row thateach user is sitting in is determined. The mobile device for each useris identified based on its location. In the example of FIG. 3, an eventin the movie triggers the same haptic event to play on all mobiledevices at the same time but the type of haptic effect may vary bylocation (i.e., haptic effect types “H1”, “H2” or H3″). For example,there may be a movie scene where an explosion occurs and those in thefront row feel the haptic effect simulated force of the explosion morestrongly than those in the middle or back rows through different hapticeffect magnitudes.

FIG. 4 is an overview diagram of the movie theater 50 that illustratesan asynchronous example in accordance with one embodiment. In thisexample, the location of the user is needed and the row that each useris sitting in is determined. Each user that receives a haptic eventreceives the same haptic effect (i.e., haptic effect “H1”). In theexample of FIG. 4, an event in the movie triggers the same haptic eventsto play only on certain user devices over time. For example, there maybe a movie scene where rats are running through a crowd and certainusers feel a haptic effect in the front row (Time T1), it stops as thatsame effect is triggered for some users in the middle row (Time T1+T2)and then that effect stops as the same effect is triggered for a fewusers in the back row (Time T1+T2+T3). In another example based on movieevent timing and seating location, a car may be racing from the leftside of the screen to the right side. As the car moves across the screena haptic effect could be sent to audience members representing thespeeding car to the left side of the room and then transition over tothe other audience members on the right side of the room as the carmoves to the right side off the screen.

FIG. 5 is an overview diagram of the movie theater 50 that illustratesanother asynchronous example in accordance with one embodiment. In theexample of FIG. 5, an event in the movie triggers different hapticevents to play only on certain user devices over time (i.e., hapticeffects “H1”, “H2” or “H3”). For example, there may be an air combatmovie scene where a jet fighter destroys an enemy fighter that explodesin midair near the left side of the screen and the victorious fighterinevitably flies through the explosion. The users in the front row leftside might feel a strong haptic explosion effect (Time T1) as the middlerow middle-left users feel a lesser haptic effect triggered as the jetmoves through the middle of the debris (Time T1+T2) and the users in theback middle feel a fading haptic effect a second later as the jetfinishes moving through the debris cloud (Time T1+T2+T3).

FIG. 6 is a flow diagram of the functionality of haptic groupbroadcasting module 16 and system 10 of FIG. 1 when broadcasting hapticeffects, at the central server, or receiving and generating broadcastedhaptic effects, at each mobile device, in accordance with oneembodiment. In one embodiment, the functionality of the flow diagram ofFIG. 6 is implemented by software stored in memory or other computerreadable or tangible medium, and executed by a processor. In otherembodiments, the functionality may be performed by hardware (e.g.,through the use of an application specific integrated circuit (“ASIC”),a programmable gate array (“PGA”), a field programmable gate array(“FPGA”), etc.), or any combination of hardware and software.

At 602, the identity/description of the haptic effect to be broadcastand generated at one or more mobile devices in the group is received bythe central server. In one embodiment, the haptic effects aresynchronized with the audio and or video of the event, such as a movietimeline. Each haptic effect can be defined by high level parametersincluding magnitude, frequency and duration. In embodiments where only asubset of users will receive the haptic effect (e.g., the first rowreceives a first type of haptic effect, the second row a second type,etc.), the identity/description will include an identity of the one ormore mobile devices to receive and generate the haptic effect.

At 604, if needed, the location and identification of each mobile deviceis determined or retrieved. As described above, the location andidentification is determined using known techniques. The identificationmay include an identity of the actuators or other haptic output devicesthat are in each mobile device.

At 606, the mobile devices that will generate the haptic effect aredetermined. For some haptic effects, all mobile devices will generatethe haptic effect, while for others only a subset of all of the mobiledevices will generate the haptic effect.

At 608, the haptic effect itself or an identity of the haptic effect isbroadcast from the central server to all identified mobile devices. Inone embodiment, the haptic effect is generally broadcast to the entiregroup and includes an identifier of the mobile devices that are togenerate the haptic effect. The mobile devices not identified willignore the broadcasted haptic effect.

At 610, each determined mobile device from 606 will generate the hapticeffect. In one embodiment, the haptic effect parameters will beretrieved from local memory and converted to motor signals that are sentto an actuator or other type of haptic output device. The actuator willthen generate a vibratory based haptic effect, or any other kind ofhaptic effect as discussed above. The haptic effect may be generated assoon as the identity of the haptic effect is received from thebroadcast, or the timing can be delayed as specified in the broadcast.

Embodiments can broadcast haptic effects, or a combination of hapticeffects and audio and visual effects. Further, embodiments can broadcastthe same haptic effects to all mobile devices, or base the broadcast onthe location of the mobile devices. Further, embodiments can broadcastthe same type of haptic effect to all mobile devices, or different typesof haptic effects to different mobile device (i.e., each haptic effectis broadcast to a subset (some) of all mobile devices). The following isa description of some of the possible implementations in accordance withembodiments of the present invention:

“Single Effect Some—triggered at once synched w/AV”: The same hapticeffect is triggered at the same time only on some mobile devices in timewith audio/visual content. An example is an explosion onscreen whereonly those seated closest to screen event are sent a haptic effect.

“Single Effect All—triggered at once synched w/AV”: The same hapticeffect is triggered on all devices at the same time in time withaudio/visual content. An example would be an on screen explosion whereevery device is sent the same haptic parameters at the same time.

“Different Effect Some—triggered at once synched w/AV”: Different hapticeffects are triggered on all devices at the same time in time withaudio/visual content. An example would be an explosion where thoseseated in the front row receive a stronger haptic effect than those inall other rows, but the effects are all triggered at the same time. Asanother example, the same effect type (e.g., a simulated gunshot hapticeffect) but different haptic effect parameters are sent to some devicesto compensate for different device actuator types (e.g., ERM, LRA,piezo, electrostatic, etc.). The goal is to create as consistent ahaptic experience across all devices by sending different parameters tosome of the devices.

“Different Effect All—triggered at once synched w/AV”: A haptic effectis triggered at the same time only on some mobile devices in time withaudio/visual content. All users feel an explosion haptic effect but withdifferent parameters for each device which could be differences inintensities. Different device actuator types could also be compensatedfor as disclosed above.

“Single Effect Some—triggered at once synched w/A only”: In anembodiment in which there is no visual element associated with thehaptic effect, only audio, only those closest to the audio element feelthe haptic effect at the same time. For example, only those seated inthe back row of the experience hear a heatbeat in the rear speakers forthe event and feel a simulated heartbeat haptic effect, but there is novisual heart beating onscreen, or perhaps the event has no screen at allas might happen at a concert hall.

“Single Effect All—triggered at once synched w/A only”: Similar to“Single Effect Some—triggered at once synched w/A only” above, but thehaptic effect would be sent to all devices equally at the same time.

“Different Effect Some—triggered at once synched w/A only”: Similar to“Different Effect Some—triggered at once synched w/AV” above but withouta visual element. Different device actuator types could also becompensated for as disclosed above.

“Different Effect All—triggered at once synched w/A only”: Similar to“Different Effect All—triggered at once synched w/AV” above but withouta visual element. Different device actuator types could also becompensated for as disclosed above.

“Single Effect Some—triggered at once synched w/V only”: Similar to“Single Effect Some—triggered at once synched w/AV” above but without anaudio element. For example, the haptic effect can be for a visualelement that makes no sound, such as an explosion in space. The audiencecould see the visual element and have a haptic effect tied to theexperience, but no audio is heard. Only those seated closest to theexplosion might feel this haptic effect.

“Single Effect All—triggered at once synched w/V only”: Same as “SingleEffect Some—triggered at once synched w/V only” above but with the samehaptic effect being sent to all devices.

“Different Effect Some—triggered at once synched w/V only”: Same as“Different Effect Some—triggered at once synched w/AV” above but withoutan audio element. For example, the haptic effect can be for athree-dimensional movie where some three-dimensional object is projectedout into the crowd, but without any associated sound. Those audiencemembers most affected by the 3D effect could receive the greatestintensity of the haptic effect playback, those less affected mightreceive a lesser intensity haptic effect and still others might receiveno haptic playback at all. Different device actuator types could also becompensated for, as disclosed above. All of these effects are triggeredat one time, not over time.

“Different Effect All—triggered at once synched w/V only”: Same as“Different Effect Some—triggered at once synched w/V only” above butsome devices receive different haptic effect parameters that may includecompensation for different actuator types.

“Single Effect Some—triggered at once separate from A/V”: The samehaptic effect is triggered at the same time only on some device but nottied to either audio/visual content. An example is completely ambienthaptic events that help set the tone or set a warning within one portionof the audience. For example, in a scary movie there may be a need towarn a portion of the crowd of an upcoming scary moment so youngchildren have a chance to cover their eyes. Further, in a concertexperience just before the band enters the arena, if the band wereentering from stage left or stage right, or even from within someportion of the audience area, it may be desired to send certain audiencemembers a haptic effect to alert that part of the crowd that the bandhas arrived in their area but the haptic effect is not tied to anyprojected visual or audio media.

“Single Effect All—triggered at once separate from A/V”: Same as “SingleEffect Some—triggered at once separate from A/V” above, but the samehaptic effect is projected to all devices.

“Different Effect Some—triggered at once separate from A/V”: Same as“Single Effect Some—triggered at once separate from A/V” above butparameters of the haptic effect intensity could come into play based ondevice locations in the audience. Different device actuator types couldalso be compensated for as disclosed above.

“Different Effect All—triggered at once separate from A/V”: Same as“Single Effect Some—triggered at once separate from A/V” above butacross all devices in the broadcast the haptic effect parameters such asintensity could vary based on device locations in the audience.Different device actuator types could also be compensated for asdisclosed above.

“Single Effect Some—triggered over time synched w/AV”: An example is ahaptic effect for a 3D movie where a some 3D object is projected outinto the crowd with associated audio. As the 3D element crosses somethreshold over time in relation to the audience members, the same hapticeffect could be triggered where some audience members, perhaps in theback of the theater, might receive no haptic playback at all. A non-3Dexample is an object zooming from one side of the screen to the otherwhere the same single haptic effect moves across the room but is onlyplayed on devices closest to the screen.

“Single Effect All—triggered over time synched w/AV”: Same as “SingleEffect Some—triggered over time synched w/AV” above, but all audiencemembers would receive the same effect over time, meaning some thresholdcondition would be met to trigger haptic effects for all audiencemembers. A non-3D example is an object zooming from one side of thescreen to the other where the same single haptic effect moves across theroom and is played on all devices in the broadcast.

“Different Effect Some—triggered over time synched w/AV”: An example isan air combat movie scene where a jet fighter destroys an enemy fighterthat explodes in midair near the left side of the screen and thevictorious fighter inevitably flies through the explosion. The users inthe front row left side might feel a strong haptic explosion effect asthe middle row middle-left users feel a lesser haptic effect triggeredas jet moves through the middle of the debris and the users in the backmiddle feel a fading haptic effect a second later as the jet finishesmoving through the debris cloud. In this example a different effect isbeing played depending on the overall scene and not everyone in theaudience necessary feels a haptic effect. Different device actuatortypes could also be compensated for as disclosed above.

“Different Effect All—triggered over time synched w/AV”: Same as“Different Effect Some—triggered over time synched w/AV” above but alldevices are included in the experience. Different device actuator typescould also be compensated for as disclosed above.

“Single Effect Some—triggered over time synched w/A only”: An example isa haptic effect for a surround sound of an invisible fly buzzing throughthe audience. The same haptic effect could be triggered over time onlyin areas of the theater where the fly sound is most prominent, but noton all user devices.

“Single Effect All—triggered over time synched w/A only”: Same as“Single Effect Some—triggered over time synched w/A only” above but withthe same haptic effect applied to all devices.

“Different Effect Some—triggered over time synched w/A only”: Same as“Single Effect Some—triggered over time synched w/A only” above but withchanges to the haptic effect parameters based on changes, for example,to the audio parameters. For example, if the sound of the flyintensified around some audience members, the haptic effect could alsointensify in that area of the theater. Different device actuator typescould also be compensated for as disclosed above.

“Different Effect All—triggered over time synched w/A only”: Same as“Different Effect Some—triggered over time synched w/A only” above buthaptic effects are playing back on all audience devices and hapticparameters can be different on each device. Different device actuatortypes could also be compensated for as disclosed above.

“Single Effect Some—triggered over time synched w/V only”: Same as“Single Effect Some—triggered at once synched w/V only” above, but anexplosion, or other visual element moves across the screen and as itdoes so, the same haptic effect is triggered for audience membersclosest to the moving object as a threshold trigger point is reached.

“Single Effect All—triggered over time synched w/V only”: Same as“Single Effect Some—triggered over time synched w/V only” above, but alldevices receive the same haptic effect when triggered.

“Different Effect Some—triggered over time synched w/V only”: Similar to“Different Effect All—triggered over time synched w/AV” above but onlybased on visual media. Instead of jet fighters, an example is spacefighters with no sound. Different device actuator types could also becompensated for as disclosed above.

“Different Effect All—triggered over time synched w/V only”: Same as“Different Effect Some—triggered over time synched w/V only” above butall devices in the room experience the haptic effect playback. Differentdevice actuator types could also be compensated for as disclosed above.

“Single Effect Some—triggered over time separate from A/V”: Similar to“Single Effect Some—triggered at once separate from A/V” above, but thehaptic effect may be moving through the crowd over time. For example, a“Haptic Wave” can be moving through the audience similar to how crowdsstand-up in a stadium to make a “human wave” but in this instance notall audience members would receive the haptic event.

“Single Effect All—triggered over time separate from A/V”: Same as“Single Effect Some—triggered over time separate from A/V” above, butall audience members would receive the haptic event.

“Different Effect Some—triggered over time separate from A/V”: Same as“Single Effect Some—triggered over time separate from A/V” above butparameters of haptic effect intensity could come into play based ondevice locations in the audience. Different device actuator types couldalso be compensated for as disclosed above.

“Different Effect All—triggered over time separate from A/V”:—Same as“Single Effect Some—triggered over time separate from A/V” above butacross all devices in the broadcast where the haptic effect parameters,such as intensity, could vary based on device locations in the audience.Different device actuator types could also be compensated for asdisclosed above.

As disclosed above, some embodiments broadcast haptic effects inresponse to an audio specific event such as live musical concert. Inthis embodiment, synchronous and asynchronous haptic events areimplemented using a streaming conversion of the live performance intohaptic events for the audience. For example, synchronous haptic effectsmay be generated through a straight audio to haptic event conversionthat is broadcast, and all audience members feel the same haptic effectregardless of location. An asynchronous embodiment can be linked to aSurround Sound where what is felt by the audience is tied to where theyare located in the audience. In this embodiment, what is broadcast tothe front/center/back of the audience, as well as left/right sides maydepend specifically on what is being projected by the sound systemsurround dynamics.

Further, in both movie and concert embodiments, audio and visualelements can also be broadcast to the mobile devices. These additionalelements could be synchronized with the main media content, or can beasynchronous. As with the example of the rats moving through theaudience, the haptic experience may be enhanced with localized visual oraudio coming straight from the user's devices.

In addition to the above embodiments, users may be able to customizetheir experience by the selection of software settings on their mobiledevice, such as by turning the strength of the haptic experience up ordown in magnitude or emphasizing certain elements of the media,including: (1) changing the bass or treble range; (2) increasing theambient content, such as the heartbeat example in the movie; (3) Addingadditional audio/video broadcast to the devices along with the haptics.Further, in some embodiments the broadcast is filtered so that a user ofa mobile device only feels via haptic effects specific elements of thecontent. For example, the filtering can cause a user to feel onlycertain instruments in a music broadcast or specific visual elements ina visual broadcast.

As disclosed, embodiments broadcast haptic effects to an audience of oneor more. Embodiments include or function with multi-modal mediacontaining sound and/or video with a “haptic track” and communicationbetween the played media and the audience's mobile devices. Embodimentsmay include application level support or a software switch on mobiledevices to interface with multi-modal content. This may be anapplication such as a custom video player or an application that acts asa haptic receiver on the user side. Haptic events from the haptic trackare played in relation to this media on the audience's mobile devices.Location mapping of all mobile devices in the audience allow for bothsynchronous and asynchronous haptic effect playback over time and cancreate a “surround haptics” experience.

Several embodiments are specifically illustrated and/or describedherein. However, it will be appreciated that modifications andvariations of the disclosed embodiments are covered by the aboveteachings and within the purview of the appended claims withoutdeparting from the spirit and intended scope of the invention.

What is claimed is:
 1. A method of generating haptic effects during agroup event having a plurality of users in attendance, the methodcomprising: receiving an identity of a first type of haptic effect to bebroadcast during the group event, wherein the group event comprises aplurality of haptic events; and broadcasting the first type of hapticeffect to a first set of the users, wherein the broadcasting causes thefirst type of haptic effect to be generated on a device corresponding toeach of the first set of users; wherein the first type of haptic effectis synchronized with one of the haptic events.
 2. The method of claim 1,wherein the broadcasted first type of haptic effect is received by amobile device corresponding to each of the first set of users.
 3. Themethod of claim 1, wherein the first type of haptic effect comprises atleast one of vibrations, deformation, squeezing, poking, stretching,friction or heat.
 4. The method of claim 1, wherein the first set ofusers is a subset of the plurality of users, and the first set of usersis determined based on a location of each of the first set of users. 5.The method of claim 1, wherein the location of each of the first set ofusers is based on a seat location of each of the first set of users. 6.The method of claim 1, wherein the group event further comprises aplurality of visual events, and the first type of haptic effect isfurther synchronized with one of the visual events.
 7. The method ofclaim 1, wherein the group event further comprises a plurality of audioevents, and the first type of haptic effect is further synchronized withone of the audio events.
 8. A non-transitory computer readable mediumhaving instructions stored thereon that, when executed by a processor,cause the processor to generate haptic effects during a group eventhaving a plurality of users in attendance, the generating comprising:receiving an identity of a first type of haptic effect to be broadcastduring the group event, wherein the group event comprises a plurality ofhaptic events; and broadcasting the first type of haptic effect to afirst set of the users, wherein the broadcasting causes the first typeof haptic effect to be generated on a device corresponding to each ofthe first set of users; wherein the first type of haptic effect issynchronized with one of the haptic events.
 9. The computer readablemedium of claim 8, wherein the broadcast first type of haptic effect isreceived by a mobile device corresponding to each of the first set ofusers.
 10. The computer readable medium of claim 8, wherein the firsttype of haptic effect comprises at least one of vibrations, deformation,squeezing, poking, stretching, friction or heat.
 11. The computerreadable medium of claim 8, wherein the first set of users is a subsetof the plurality of users, and the first set of users is determinedbased on a location of each of the first set of users.
 12. The computerreadable medium of claim 8, wherein the location of each of the firstset of users is based on a seat location of each of the first set ofusers.
 13. The computer readable medium of claim 8, wherein the groupevent further comprises a plurality of visual events, and the first typeof haptic effect is further synchronized with one of the visual events.14. The computer readable medium of claim 8, wherein the group eventfurther comprises a plurality of audio events, and the first type ofhaptic effect is further synchronized with one of the audio events. 15.A broadcast system for a group event having a plurality of users inattendance, the system comprising; a receiving module that receives anidentity of a first type of haptic effect to be broadcast during thegroup event, wherein the group event comprises a plurality of hapticevents; and a broadcast module that broadcasts the first type of hapticeffect to a first set of the users, wherein the broadcasting causes thefirst type of haptic effect to be generated on a device corresponding toeach of the first set of users, wherein the first type of haptic effectis synchronized with one of the haptic events.
 16. The system of claim15, wherein the broadcasted first type of haptic effect is received by amobile device corresponding to each of the first set of users.
 17. Thesystem of claim 15, wherein the first type of haptic effect comprises atleast one of vibrations, deformation, squeezing, poking, stretching,friction or heat.
 18. The system of claim 15, wherein the first set ofusers is a subset of the plurality of users, and the first set of usersis determined based on a location of each of the first set of users. 19.The system of claim 15, wherein the location of each of the first set ofusers is based on a seat location of each of the first set of users. 20.The system of claim 15, wherein the group event further comprises aplurality of visual events, and the first type of haptic effect isfurther synchronized with one of the visual events.
 21. The system ofclaim 15, wherein the group event further comprises a plurality of audioevents, and the first type of haptic effect is further synchronized withone of the audio events.